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TITLE OF THE INVENTION 
COLOR IMAGE DISPLAY SYSTEM 

s CROSS-REFERENCE TO RELATED APPLICATIONS 
This application is based upon and claims the 
benefit of priority from the prior Japanese Patent 
Applications No. X-152873, filed May 31, 1999; and 
No. 2000-131462, filed April 28, 2000, the entire 
contents of which are incorporated herein by reference. 
BACKGROUND OF THE INVENTION 
The present invention relates to a color image 
display system and, more particularly, to a color image 
display system having an image data conversion 
apparatus which converts input image data into display 
color image data to synthetically display partial color 
images displayed by a plurality of partial color image 
display apparatuses as a color image of one frame. 

In recent years, color image display systems for 
synthesizing display images by a plurality of 
projectors and displaying one precise and large image 
have been proposed and put into practical use. 

More specifically, each system projects and 
displays partial color images on a screen using a 
plurality of projectors, thereby synthetically 
displaying a color image of one frame on the screen. 

In such a system for displaying a color image of 
one frame by synthesizing display images by a plurality 
of projectors, a pixel position shifts or reproduction 
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luminance changes between display images by the 
projectors due to geometric distortion or luminance 
difference between the projectors. 

Additionally, since this system generally 
5 synthesizes the display images by the projectors by 

making them partially overlap, color misregistration 
occurs in the overlap region due to the adjustment 
error in each display image. 

Conventionally, to solve these problems, the 

10 geometric distortion is corrected by adjusting the 

projection position of each projector or correcting 
image data, and color misregistration is corrected by 
correcting image data in the overlap region between the 
display images by the projectors. 

15 However, according to examinations by the present 

inventors, only the above-described geometric 
distortion correction and color misregistration 
correction in the overlap region between the display 
images by the projectors are insufficient to finally 

20 synthetically display a color image of one frame with a 

satisfactory quality. 

BRIEF SUMMARY OF THE INVENTION 
It is an object of the present invention to 
provide a color image display system capable of 

25 synthetically displaying a plurality of partial 

color images as a color image of one frame with a 
satisfactory quality. 
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In order to solve the above problems, according to 
the present invention, in a color image display system 
comprising a plurality of partial color image display 
means for, upon receiving display color image data, 
5 displaying partial color images to be synthetically 

displayed as a color image of one frame, and image data 
conversion means for converting input color image data 
into the display color image data to be input to the 
partial color image display means, the image data 
10 conversion means or partial color image display means 

is designed to have the following arrangement. 

(1) The image data conversion means comprises 
color correction means for correcting the difference in 
color reproduction characteristic between the partial 

15 color image display means. With this color correction 

means, even when the plurality of partial color image 
display means have different color reproduction 
characteristics, displayed colors match in the entire 
color image synthetically displayed as one frame. 

2 0 Hence, discontinuous joints between the partial color 

images are eliminated, and a high-quality color image 
can be displayed as a whole. 

(2) The image data conversion means comprises 
correction means for correcting a bias of the input 

25 color image data so as to display the partial color 

images on a predetermined set bias in the plurality of 
partial color image display means. When the correction 
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means for correcting the bias is provided, a case 
wherein the display color image data input to the 
partial color image display means has a value smaller 
than the bias and cannot be reproduced is eliminated or 
5 reduced. 

(3) The image data conversion means comprises data 
distribution means for distributing the input color 
image data to the display color image data to be input 
to the partial color image display means so as to 

10 display, at a predetermined ratio in an overlap region, 

the partial color images contained in the overlap 
region between the partial color images displayed by 
the partial color image display means . With this data 
distribution means, even in the overlap region where 

15 the partial color images by the plurality of partial 

color image display means overlap, a desired color can 
be accurately displayed. 

(4) The image data conversion means comprises 
nonuniformity correction means for correcting a color 

20 nonuniformity in partial color image displayed by the 

partial color image display means. When the partial 
color image displayed by each partial color image 
display means is corrected by the color nonuniformity 
correction means, high-quality display is done in each 

25 partial color image, and also discontinuous boundaries 

between the partial color image due to the color 
nonuniformity which changes in units of partial color 



image display means can be prevented. 

(5) The partial color image display means are 
designed to display the partial color images with 
display luminance lower in an overlap region between 
the partial color image displayed by one partial color 
image display means and the partial color image 
displayed by the other partial color image display 
means than in a remaining region. When each partial 
color image display means has such a design, an 
increase in bias in the overlap region can be 
eliminated or reduced. 

(6) As the partial color image display means in 
(1) to (5), a multi-primary-color display having at 
least four primary colors may be used whereby a wider 
color reproduction range can be attained. 

Additional objects and advantages of the invention 
will be set forth in the description which follows, and 
in part will be obvious from the description, or may be 
learned by practice of the invention. The objects and 
advantages of the invention may be realized and 
obtained by means of the instrumentalities and 
combinations particularly pointed out hereinafter. 

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING 
The accompanying drawings, which are incorporated 
in and constitute a part of the specification, 
illustrate presently preferred embodiments of the 
invention, and together with the general description 



given above and the detailed description of the 
preferred embodiments given below, serve to explain the 
principles of the invention. 

FIG. 1 is a block diagram showing the schematic 
arrangement of a color image display system according 
to the first embodiment of the present invention; 

FIG. 2 is a block diagram showing the internal 
arrangement of an image data conversion apparatus of 
the first embodiment; 

FIG. 3 is a view showing a measurement system for 
measuring the color reproduction characteristics of 
projectors; 

FIG. 4 is a block diagram showing the internal 
arrangement of a color correction unit of the first 
embodiment ; 

FIG. 5 is a view showing partial display images by 
the projectors and the bias distribution of the 
synthesized display images in the first embodiment; 

FIGS. 6A, 6B, and 6C are views showing examples of 
a set bias in the first embodiment; 

FIG. 7 is a view schematically showing the actual 
bias and image data, which are projected onto the white 
axis in the first embodiment; 

FIG. 8 is a view showing the distribution of 
distribution coefficients of data distribution units of 
the first embodiment; 

FIG. 9 is a block diagram showing the internal 



arrangement of an image data conversion apparatus 
according to the second embodiment of the present 
invention; 

FIG. 10 is a block diagram showing the schematic 
arrangement of a color image display system according 
to the third embodiment of the present invention; 

FIG. 11 is a block diagram showing the internal 
arrangement of an image data conversion apparatus of 
the third embodiment; 

FIG. 12 is a view showing the concept of gain/bias 
correction in the third embodiment; 

FIG. 13 is a block diagram showing the internal 
arrangement of an image data conversion apparatus 
according to the fourth embodiment of the present 
invention; 

FIG. 14 is a block diagram showing the internal 
arrangement of a color correction unit of the fourth 
embodiment ; 

FIGS. 15A and 15B are views showing arrangement 
examples of projectors in the fourth embodiment; 

FIG. 16 is a view showing the transmittance 
distributions of ND filters installed in the 
projectors ; 

FIG. 17 is a view showing the distribution of a 
synthetic bias by the projector having the ND filter 
with the transmittance distribution shown in FIG. 16; 

FIGS. 18A to 18D are views showing synthetic bias 



distributions ; 

FIG- 19 is a view showing another arrangement 
example of the projector in the fourth embodiment; 

FIG. 20 is a view showing still another 
arrangement example of the projector in the fourth 
embodiment; 

FIG. 21 is a view showing still another 
arrangement example of the projector in the fourth 
embodiment ; 

FIG. 2 2 is a view showing still another 
arrangement example of the projector in the fourth 
embodiment ; and 

FIG. 2 3 is a view showing another distribution of 
distribution coefficients of a data distribution unit. 
DETAILED DESCRIPTION OF THE INVENTION 

The embodiments of the present invention will be 
described below with reference to the accompanying 
drawing . 

(First Embodiment) 

FIG. 1 shows a color image display system 
according to the first embodiment of the present 
invention. This color image display system comprises 
an image input apparatus 1, image data conversion 
apparatus 2, projectors 3A and 3B, and screen 4. 

The image input apparatus 1 obtains, as input 
color image data, image data having three channels for 
RGB (red, green, and blue) per pixel, which is obtained 
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by sensing an object using, e.g., a digital camera. 

The image input apparatus 1 has a linear 
sensitivity characteristic, and the input color image 
data is also linear with respect to luminance. The 
5 input color image data obtained by the image input 

apparatus 1 is output to the image data conversion 
apparatus 2 . 

The image data conversion apparatus 2 converts the 
input color image data from the image input apparatus 1 
10 into display color image data for the two projectors 3A 

and 3B serving as partial color image display means and 
outputs the image data to the corresponding projectors 
3A and 3B. 

In this embodiment, each of the projectors 3A and 
15 3B is a 3 -primary-color projector using RGB colors, 

which projects and displays a partial color image on 
the screen 4 in accordance with the input display color 
image data. 

The partial color image displayed on the screen 4 
20 by the projector 3A or 3B will also be referred to as a 

partial display image hereinafter. The partial display 
images are synthetically displayed on the screen 4 as a 
large color image of one frame (also to be referred to 
as a synthesized display image hereinafter) as a whole. 
25 In this case, the partial display images by the 

projectors 3A and 3B partially overlap on the synthe- 
sized display image on the screen 4, as shown in FIG. 1. 
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The image data conversion apparatus 2 will be 
described next in detail with reference to FIG. 2. 

The image data conversion apparatus 2 is 
constructed by color correction units 11A and 11B, 
5 geometrical correction units 12A and 12B, bias 

correction units 13A and 13B, data distribution units 
14A and 14B, and gray scale correction units 15A and 
15B, which are prepared in correspondence with the 
projectors 3A and 3B, respectively. 

10 The color correction units 11A and 11B, 

geometrical correction units 12A and 12B, bias 
correction units 13A and 13B, data distribution units 
14A and 14B, and gray scale correction units 15A and 
15B have identical structures. The arrangement of each 

15 part of the image data conversion apparatus 2 will be 

described below. 

[Color Correction Units 11A and 11B] 

Input color image data (input signal values R, G, 

and B) within image regions displayable by the 
20 projectors 3A and 3B are input from the image input 

apparatus 1 to the color correction units 11A and 11B. 
The input color image data do not depend on the 

characteristics of the projectors 3A and 3B. The 

signal values R, G, and B of these input image data are 
25 converted into unique signal values (called display 

signal values) suitable to display by the projectors 3A 

and 3B by the color correction units 11A and 11B in 
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accordance with the color reproduction characteristics 
of the projectors 3A and 3B, respectively. 

FIG. 3 shows a measurement system for measuring 
the color reproduction characteristics of projectors 3A 
5 and 3B. On the basis of color image data output from 

an image output apparatus 5, single-color images of R 
(red), G (green) , and B (blue) are projected onto the 
screen 4 by the projectors 3A and 3B. 

XYZ tristimulus values in the maximum light 

10 emission of these single-color images are measured from 

a patch image 6 on the screen 4 by a measurement 
instrument such as a spectrophotometer 7, thereby 
obtaining the color reproduction characteristics of the 
projectors 3A and 3B. 

15 To measure the color reproduction characteristics, 

an image sensing apparatus such as a digital camera may 
be used. In this case, single-color images of R (red), 
G (green), and B (blue) are projected onto the screen 4 
by the projectors 3A and 3B on the basis of color image 

20 data output from the image output apparatus 5, and 

the images in the maximum light emission of these 
single-color images are sensed by the image sensing 
apparatus to obtain signal values, thereby obtaining 
the color reproduction characteristics of the 

25 projectors 3A and 3B. 

The resultant color reproduction characteristics 
of the projectors 3A and 3B are supplied to the color 
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correction units 11A and 11B, respectively. Each of 
the color correction units 11A and 11B converts the 
signal values R, G, and B of the input color image data 
into signal values (display signal values) R' , G', and 
B' of display color image data by linear conversion 
represented by 



f R >\ 
G' 



( a n a l2 a B Y R\ 



a 2l a 22 a 23 



B 



.(1) 



where X r , X g , and X b are X values in the maximum light 

10 emission by the signal values R' , G', and B', Y r , Yg, 

and Yb are Y values in the maximum light emission by 
the signal values R', G' , and B' f and Z r , Z g , and Z b 
are Z values in the maximum light emission by the 
signal values R', G', and B'. 

15 The color reproduction characteristics of the 

projectors 3A and 3B are represented by the X, Y, and Z 
values. Additionally, aij is an element of a matrix A 
for converting the input color image data R, G, and B 
into the XYZ tristimulus values. 

20 To measure the color reproduction characteristics, 

an image sensing apparatus may be used. In this case, 
as described above, single-color images of R (red), G 
(green), and B (blue) are projected onto the screen 4 
by the projectors 3A and 3B on the basis of color image 

25 data output from the image output apparatus 5, and the 

images in the maximum light emission of these 



single-color images are sensed by the image sensing 
apparatus to obtain signal values, thereby obtaining 
the color reproduction characteristics of the 

projectors 3A and 3B. 
5 The resultant color reproduction characteristics 

of the projectors 3A and 3B are supplied to the color 
correction units 11A and 11B, respectively. Each of 
the color correction units 11A and 11B converts the 
signal values R, G, and B of the input color image data 
10 into signal values (display signal values) R', G' , and 

B' of display color image data by linear conversion 
represented by 

r X r X g X b XU ian a u YR> 

a 2l a 22 a 23 G —(2) 

15 where aij is an element of the matrix A for converting 

the input color image data R, G, and B into the XYZ 
tristimulus values, X r , Y r , and Z r are XYZ values in 
the maximum light emission of R (red), X g , Y g , and Z g 
are XYZ values in the maximum light emission of G 

20 (green), and X b , Y b , and Z b are XYZ values in the 

maximum light emission of B (blue). These values are 
calculated by next equation on the basis of the signal 
values output from the image sensing apparatus. 
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where a matrix M is a matrix (chromaticity conversion 
matrix) for converting image signal values S obtained 
by the image sensing apparatus into XYZ values, and n 
5 is the number of channels of the image sensing 

apparatus . 

The image signal value S is a signal value 
obtained by the image sensing apparatus. For example, 
an image signal value S r i means the signal value of the 

10 first channel in the maximum light emission of R (red). 

The chromaticity conversion matrix M is obtained in 
advance on the basis of the input/output charac- 
teristics of the image sensing apparatus. 

As an image sensing apparatus, a TV camera, 

15 digital camera, or multiband camera having at least 

four channels can be used. In the above description, 
the images in the maximum light emission of the 
single-color images of RGB are sensed to acquire the 
color reproduction characteristics. However, an 

2 0 arbitrary color images may be used as long as they are 

combination of independent signal values. 

If the above-described chromaticity conversion 
matrix M is not obtained in advance, color correction 
of each projector is performed on the basis of next 
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equation, 



G' 
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where a'^j is an element of a matrix A' for converting 
5 the input color image data R, G, and B into signal 

values in a desired RGB space. The value S is a signal 
value acquired by the image sensing apparatus. For 
example, a signal value S r i means the signal value of 
the first channel in the maximum light emission of R 

10 (red). 

FIG. 4 shows the detailed arrangement of the color 
correction unit 11A (11B). The color correction unit 
11A (11B) comprises a matrix calculation unit 21, 
matrix data storage unit 22, and matrix conversion 

15 unit 23. 

The above-described matrix A and color 
reproduction characteristic of the projector 3A (3B) 
are measured or set in advance and input to the matrix 
calculation unit 21. The matrix calculation unit 21 

20 calculates a matrix for converting the signal values R, 

G, and B of the input color image data into the display 
signal values R', G' , and B'. The matrix calculated by 
the matrix calculation unit 21 is stored in the matrix 
data storage unit 22. 

25 In conversion, the matrix conversion unit 23 reads 

out predetermined matrix data from the matrix data 
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storage unit 22 and converts the signal values R, G, 
and B of the input color image data into the display 
signal values R' , G', and B' on the basis of equation 
(1). The matrix data stored in the matrix data storage 
5 unit 22 changes depending on a change in charac- 

teristics of the projector 3A (3B) or in units of image 
input apparatuses 1. For this reason, the matrix data 
storage unit 22 can store/rewrite a plurality of data. 
Thus, the color correction units 11A and 11B correct 

10 the color reproduction characteristics of the 

projectors 3A and 3B, respectively. 
[Geometrical Correction Units 12A and 12B] 

The display signal values R' , G', and B' output 
from the color correction units 11A and 11B are input 

15 to the geometrical correction units 12A and 12B. The 

geometrical correction units 12A and 12B perform 
geometrical correction on the display signal values R', 
G', and B' such that the partial display images are 
projected at correct positions by the projectors 3A 

20 and 3B. 

Details of the geometrical correction are 
disclosed in Jpn. Pat. Appln. KOKAI Publication 
No, 9-326981, and a detailed description thereof will 
be omitted. 

25 [Bias Correction Units 13A and 13B] 

The signal values R', G', and B' of the color 
image data geometrically corrected by the geometrical 



correction units 12A and 12B are input to the bias 
correction units 13A and 13B. 

The bias correction units 13A and 13B set a set 
bias at each pixel position of the projectors 3A and 3B 
5 on the basis of actual bias data of the projectors 3A 

and 3B and position data of the overlap region between 
the partial display images by the projectors 3A and 3B, 
and corrects the biases of the signal values R', G' , 
and B' such that the partial display images are 
10 displayed on the set bias. The actual bias means a 

color displayed when all the RGB input signals to the 
projectors 3A and 3B are 0. 

FIG- 5 shows the biases of the projectors 3A and 
3B (actual biases of the partial display images by 
15 the projectors 3A and 3B) and an example of bias 

distribution of the synthetic bias of the projectors 3A 
and 3B (actual bias of the synthesized display image). 
FIGS. 6A to 6C show examples of a set bias. 

Referring to FIGS. 5 and 6A to 6C, the abscissa 
20 represents two-dimensional pixel positions (x,y), 

and the ordinate represents a three-dimensional color 
space C. 

Referring to FIG. 6A, a predetermined value equal 
to the maximum value of the actual bias of the entire 
25 display screen of the projectors 3A and 3B is set as a 

set bias . 

Referring to FIG. 6B, near the center of the 
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screen including the maximum value of the actual bias 
of the projectors 3A and 3B, the set bias is set to be 
equal to the maximum value of the actual bias. The set 
bias smoothly decreases toward the periphery of the 
5 screen. 

The maximum value of the actual bias of the 
projectors 3A and 3B means a bias with which the 
projective vector of a predetermined color vector (e.g., 
white vector) is maximized. 

10 When image data is displayed with a distribution 

on the set bias shown in FIG. 6A or 6B, the image can 
be prevented from becoming dark and impossible to 
display because of the image data value smaller than 
the actual bias of the projectors 3A and 3B, or being 

15 clipped and displayed as an unnatural image. 

Referring to FIG. 6C, a set bias is obtained in 
units of pixel positions on the basis of the 
relationship between the actual bias in the entire 
display region of the projectors 3A and 3B and all 

20 image data input to the bias correction units 13A 

and 13B. 

More specifically, a set bias is set such that the 
difference vector in projective vector to white vector 
(white axis) between image data and actual bias (i.e., 
25 the difference in color projected onto the white axis 

between image data and actual bias) is maximized. 
FIG. 7 schematically shows the actual bias and image 



data, which are projected onto the white axis. 

Let B(x,y) be actual bias at each pixel position 
of the projectors 3A and 3B, I(x,y) be image data 
corresponding to each pixel position, and W be the 
5 white axis of the display image. Norms N B (x,y) and 

Nj(x,y) of the projective vectors of the actual bias 
B(x,y) and image data I(x,y) onto the white axis W are 
given by 

N B {x y y) = {B^yyW)l\W\\ (5) 
10 NAx 9 y) = (I(x,y).W)/lW\\ 

where • is inner product calculation, and || || is the 

norm of a vector. A set bias is set as a vector in the 

direction of white axis W, which has a norm N w at a 

pixel position (x,y) at which the norm difference 

15 AN(x,y) = N B (x,y) - N x (x f y) between the projective 

vectors is maximized, and is given by 

B s =N w Wl\W\ -(6) 
When a set bias is defined in units of pixel 
20 positions on the basis of the relationship between 

actual bias of the projectors 3A and 3B and image data 
input to the bias correction units 13A and 13B for 
actual display by the projectors 3A and 3B, color 
misregistration by the set bias can be minimized. In 
25 addition, generation of image data that is darker than 

the projective value of the set bias to the white axis 
and therefore cannot be reproduced can be avoided. 
Let R 0 (x,y), G 0 (x,y), and B 0 (x,y) be display 
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signal values corresponding to the actual bias at each 
pixel position of the projectors 3A and 3B, and Rb(x,y), 
Gb(x,y), and B b (x,y) be display signal values corre- 
sponding to the set bias. Display signal values 
5 R"(x,y), 6" (x,y), and B"(x,y) after bias correction are 

given by 

R\x,y) = R'(x,y) + R b (x,y)-R 0 (x,y) 

G\x,y) = GXx,y) + G b (x,y)-G 0 (x,y) - ( 7 ) 

B"(x,y) = B'(x,y) + B b (x,y)-B 0 (x,y) 

Using tristiraulus values X 0 (x,y) / Y 0 (x,y), and 
10 Z 0 (x,y) of the actual bias, the display signal values 

R0( x 'YK g 0( x 'Y)' and B 0( X 'Y) corresponding to the 
actual bias at each pixel position are given by 
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15 m a similar way, using tristimulus values Xb(x,y), 

Yb(x,y), and Z b (x,y), the display signal values R b (x,y) , 
G b (x,y), and B b( x 'Y) corresponding to the set bias at 
each pixel position are given by 
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As the tristimulus values Xo(x,y), Yo(x,y), and 
Zo( x fY) of the actual bias, XYZ values measured near 
the central portion of the projectors 3A and 3B are 
used, as in measuring the color reproduction 
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characteristics of the projectors 3A and 3B by the 
measurement system shown in FIG. 3. 

If the tristimulus values X 0 (x,y), Yo(x,y), and 
Z 0 (x,y) cannot be sufficiently accurately measured or 
5 fall outside the luminance range measurable by the 

measurement instrument, X 0 (x,y) = Y 0 (x,y) = Z 0 (x,y) = 0 
may be assumed. 

In the overlap region between the partial display 
images by the projectors 3A and 3B, XYZ values 
10 calculated as the sum of biases of the projectors 3A 

and 3B are used as the tristimulus values Xo(x,y), 
Y 0 (x,y) , and Z 0 (x,y) . 

The actual bias and set bias of the projectors 3A 
and 3B are measured or set in advance and stored in 
15 the bias correction units 13A and 13B. A plurality of 

bias data are stored in accordance with a change in 
characteristics of the projectors 3A and 3B or the 
difference in set bias setting method and appropriately 
rewritten. 

20 [Data Distribution Units 14A and 14B] 

The data distribution units 14A and 14B distribute 
the color image data after bias correction, which are 
input from the bias correction units 13A and 13B, to 
display color image data in units of pixels. 

25 In this image data distribution processing, the 

color image data input to the data distribution units 
14A and 14B are corrected and distributed to the output 



side such that, in the overlap region between the 
partial display images by the projectors 3A and 3B, the 
partial display images included in the overlap region 
are displayed at a predetermined ratio. 

More specifically, this data distribution 
processing is performed by multiplying the signal 
values of display color image data after bias 
correction by distribution coefficients Kl(x,y) and 
K2(x,y) so that the sum of display signal values of 
display color image data to be input to the projectors 
3A and 3B matches the sum of display signal values of 
original display color image data after bias correction, 
as shown in FIG. 8. 

Display signal values R"'l(x,y), G"'l(x,y), and 
B'''l(x,y) of RGB colors at the pixel position (x,y), 
which are distributed to the projector 3A, are given by 

R m l(x,y) = K\(x,y)R"(x,y) 

G fff l(x,y) = Kl(x,y)G\x,y) -(10) 
B m l(x,y) = Kl(x,y)B"(x,y) 

Display signal values R'"2(x,y), G'"2(x,y), and 
B'''2(x,y) of RGB colors at the pixel position (x,y), 
which are distributed to the projector 3B, are given by 

R m 2(x,y) = K2(x,y)RXx,y) 

G m 2(x 7 y) = K2(x 7 y)G tt (x,y) -(H) 
B"2(x,y) = K2(x,y)B"(x,y) 

for 

K2(x 9 y) = \-Kl(x,y) -(12) 

The distribution coefficients Kl(x,y) and K2(x,y) 



are set to be smaller as the pixel position becomes far 
from the central position of the partial display images 
projected by the projectors 3A and 3B, as shown in 
FIG- 8. 

5 When a random number is added to one of the 

distribution coefficients Kl(x,y) and K2(x,y) set in 
the above-described way, and the distribution 
coefficients are re-calculated, the boundary between 
the partial display images in the overlap region due to 
10 a display error can be made unnoticeable . For example, 

the distribution coefficients Kl(x,y) and K2(x,y) are 
re-calculated on the basis of 

Kl'(x 9 y) = K\(x,y) + R(Kl(x,y)) ^ 
K2'(x,y) = l-KV(x 9 y) 

15 Kl'(x,y) and K2'(x f y) are re-calculated distribution 

coefficients. R(x) is a random number within the 

following range 

-X<R(X)<1-X -(14) 
20 The distribution coefficients Kl(x,y) and K2(x,y) 

before re-calculation are set in advance in the data 

distribution units 14A and 14B. 

Processing from the color correction units 11A and 

11B to the data distribution units 14A and 14B is 
25 summarized as follows. The input color image data 

R(x,y), G(x / y) / and B(x,y) at the pixel position (x,y) 

are converted into display color image data R'''(x,y), 

G'''(x,y), and B"'(x,y) given by 
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'R"'(x,y)^ 
G"\x,y) 

'K{x,y)00 
OK(x,y)0 



OQK(x,y)j 



r X r X g X^\ 

r g b 
yZ,.Z g Z b J 



r a n a n a u Y R{x,y)\ (R b {x,yf\ (R 0 (x,y)^ 



a 2\ a 22 a 2Z 
\ a 3\ a 32 a 33 J 



G(x,y) 
B{x,y), 



+ 



G b (x,y) 

B b (x>y)) 



G 0 (x,y) 



-(15) 

where K is the distribution coefficient Kl(x,y) or 
K2(x,y), or the re-calculated distribution coefficient 
5 Kl' (x,y) or K2' (x,y) . 

[Gray Scale Correction Units 15A and 15B] 

The color image data R'"(x,y), G'"(x,y), and 
B'"(x,y) output from the data distribution units 14A 
and 14B are input to the corresponding gray scale 

10 correction units 15A and 15B. The gray scale 

correction units 15A and 15B execute gray scale 
correction on the color image data R'''(x,y), G'"(x,y), 
and B"'(x,y) output from the data distribution units 
14A and 14B to obtain RGB data R ou t' G out' and B out 

15 given by 

G out =r?(G") (16) 

and output the RGB data R out / Gout' and B out to the 
projectors 3A and 3B as final display color image data. 
20 In this case, y c " 1 ( d ) ( c = r ' b ) is 9 ra Y scale 

correction data as an inverse function of output 
luminance with respect to an input signal value d whose 
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maximum value is normalized to 1. 

This gray scale correction data 7 c " 1 ( d ) ^ s 
obtained by measuring the display luminance of the 
projectors 3A and 3B ranging from 0 to the maximum 
5 value of the input signal value of each of the RGB 

primary colors of the projectors 3A and 3B using the 
same measurement system as shown in FIG. 3, and stored 
in advance in the gray scale correction units 15A 
and 15B. 

10 To acquire the gray scale correction data y c " 1 (d) f 

a spectrophotometer , colorimeter, luminance meter, or 
image sensing apparatus can be used, A method of 
acquiring gray scale correction data using a 
spectrophotometer, colorimeter, or luminance meter for 

15 spot light measurement is accurate but time-consuming. 

To the contrary, according to a method of 
acquiring gray scale correction data using an image 
sensing apparatus, when a gradation pattern is 
displayed and sensed, the gray scale correction data 

20 can be acquired by one sensing operation. In this case, 

when the shading of the image sensing apparatus is 
corrected, more accurate data can be acquired. 
(Second Embodiment) 

FIG. 9 shows the arrangement of an image data 

25 conversion apparatus 2 in a color image display system 

according to the second embodiment of the present 
invention. The arrangement of the second embodiment is 



I 



f 
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the same as in the first embodiment except the image 
data conversion apparatus 2, and a detailed description 
thereof will be omitted. 

The image data conversion apparatus 2 of this 
5 embodiment comprises color correction units 11A and 111 

geometrical correction units 12A and 12B, bias correc- 
tion units 16A and 16B, data distribution units 14A and 
14B, nonuniformity correction units 17A and 17B, and 
gray scale correction units 15A and 15B, which are 
10 prepared in correspondence with projectors 3A and 3B 

shown in FIG. 1. 

The arrangement of the image data conversion 
apparatus 2 of the second embodiment is the same as in 
the first embodiment except the bias correction units 
15 16A and 16B and nonuniformity correction units 17A and 

17B, and a detailed description thereof will be omitted 
Only the bias correction units 16A and 16B and 
nonuniformity correction units 17A and 17B will be 
described. 

20 [Bias Correction Units 16A and 16B] 

In this embodiment, bias correction by the bias 
correction units 16A and 16B is performed using bias 
data measured in units of pixels, thereby coping with a 
case wherein the bias changes in units of pixels, 
25 unlike the first embodiment. 

Display signal values Rg(x,y), Go(x,y), and 
Bo(x,y) of RGB colors corresponding to actual bias at 
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each pixel position, which are obtained on the basis of 
a color image signals Rd(x,y), G d (x,y) , and B d (x,y) 
obtained by sensing partial color images displayed by 
the projectors 3A and 3B with a digital camera, are 
5 given by 







' R r R g R b ^ 


-1 






G 0 (x,y) 




G r G g G b 




G d ix,y) 


•■(17) 






iw J 




K B d {x,y)j 





where R s , G s , and B s (s = r, g, b) are R signal value, 
G signal value, and B signal value, respectively, which 

10 are obtained by sensing, with a digital camera, colors 

in the maximum light emission by s primary colors of 
the projectors 3A and 3B. If the display signal values 
R()( X 'Y)' G 0( X 'Y)' and B 0( X 'Y) cannot be sufficiently 
accurately measured or calculated, Ro(x,y) = G()(x,y) = 

15 Bg(x,y) = 0 may be assumed. 

[Nonunif ormity Correction Units 17A and 17B] 

This embodiment assumes that colors in the partial 
color images displayed by the projectors 3A and 3B are 
nonuniform due to the luminance difference between 

20 pixel positions. 

The luminance difference changes in units of RGB 
primary colors . Each primary color has a predetermined 
chromaticity value for each pixel position. In this 
case, image data R"'(x,y), G"'(x,y), and B"'(x,y) 

25 corresponding to the light emission colors of the RGB 

primary colors and display color image data R''''(x,y), 
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(x,y), and B" " (x,y) have a relation 



M fk r (x,y)00\R m \x,y^ 



10 



15 



G"'(x,y) 
{B"'(x,y)J 



0k g (x,y)0 G'"\x,y) -(18) 

where kr(x,y), kg(x,y) , and kb(x,y) are luminance 
nonuniformities of the RGB primary colors. Hence, the 
display color image data R" " (x,y) , G""(x,y), and 
B''''(x,y) after the luminance nonuniformities are 
corrected are given by 



r R m '(x,y) 
G m '(x,y) 
K B""{x,y)) 



Vk r (x,y)00YR m (x,y) 
0Vk g (x,y)0 G m (x,y) 
00Vk b (x,y)XB m (x,y)) 

(l/k r (x,y)00YK(x,y)00 
01/k g (x,y)0 0K(x,y)0 
00\/k b (x,y)){oOK(x,y)) 



r R b (x,y)') (Ro(x,y) 



X r X g X b 



fa u a n a u YR(x,y) 

G(x,y) 

AB(x,y) 



20 



G b (x,y) - G 0 (x,y) 
{B b (x,y)J [B 0 (x,y)J) 

-(19) 

On the basis of equation (19), the nonunif ormity 
correction units 17A and 17B correct color 
nonuniformities by linear conversion using a color 
nonuniformity correction coefficient l/k s (x,y) (s = r, 
g, b) that changes in units of pixel positions and RGB 
primary colors. 

The value k s (x,y) is obtained from RGB primary 
color signals at each pixel position, which are 
obtained by sensing, with a digital camera, the display 
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images in the maximum light emission of the RGB primary 

colors of the projectors 3A and 3B. 

A digital camera having a sensitivity 

characteristic linear with respect to luminance or 
5 signal values corrected to obtain linear sensing 

signals with respect to luminance are used. 

( Third Embodiment ) 

FIG. 10A shows a color image display system 

according to the third embodiment of the present 
10 invention. 

This color image display system comprises an 

image input apparatus 31 , image data conversion 

apparatus 32, multi-primary-color projectors 33A and 

33B, and screen 34. 
15 The image input apparatus 31 inputs image data 

having three channels per pixel, which is obtained 

by sensing an object using, e.g., a digital camera. 

The image input apparatus 31 has a sensitivity 

characteristic linear with respect to luminance, and 
20 the input color image data is also linear with respect 

to luminance . 

The input color image data input by the image 

input apparatus 31 is output to the image data 

conversion apparatus 32. 
25 The image data conversion apparatus 32 converts 

the input color image data from the image input 

apparatus 31 into display color image data for the two 



multi-primary-color projectors 33A and 33B serving 
as partial color image display means and outputs the 
image data to the corresponding multi-primary-color 
projectors 33A and 33B. 
5 Each of the multi-primary-color projectors 33A 

and 33B is, e.g., a 6 -primary-color projector which 
projects and displays a partial color image on the 
screen 34 in accordance with 6-channel display color 
image data input from the image data conversion 

10 apparatus 32. The partial color images are 

synthetically displayed on the screen 34 as a large 
color image of one frame. In this case, the partial 
display images by the projectors 33A and 33B partially 
overlap on the synthesized display image. 

15 The image data conversion apparatus 32 will be 

described next in detail with respect to FIG. 11. As 
shown in FIG. 11, the image data conversion apparatus 
32 comprises color correction units 41A and 4 IB, 
geometrical correction units 42A and 42B, primary color 

20 luminance correction units 43A and 43B, and gray scale 

correction units 44A and 44B, which are prepared in 
correspondence with the multi-primary-color projectors 
33A and 33B. 

[Color Correction Units 41A and 4 IB] 
25 Input color image data within color regions 

displayable by the multi-primary-color projectors 33A 
and 33B are input from the image input apparatus 31 to 



the color correction units 41A and 4 IB. 

The input color image data do not depend on the 
characteristics of the multi-primary-color projectors 
33A and 33B. The input image data are converted into 
5 display color image data having 6-channel signal values 

unique to the multi-primary-color projectors 33A and 
33B in accordance with the color reproduction 
characteristics of the multi-primary-color projectors 
33A and 33B. 

10 The color reproduction characteristics of the 

multi-primary-color projectors 33A and 33B are obtained, 
using the measurement system shown in FIG. 3, by 
causing the multi-primary-color projectors 33A and 33B 
to project single-color images of the six primary 

15 colors onto the screen 34 on the basis of 6-primary- 

color data (CI, C2, C3, C4, C5, and C6 ) , and measuring 
XYZ tristimulus values in the maximum light emission 
of these single-color images using a measurement 
instrument such as a spectrophotometer. 

20 The obtained color reproduction characteristics 

are supplied to the color correction units 41A and 4 IB. 
Each of the color correction units 41A and 4 IB converts 
input color image data R, G, and B into display color 
image data (CI, C2, C3, C4, C5, and C6) by 



rcn 






C2 






C3 






C4 






C5 






,C6, 







r a a a Y 

^ a 3i a 32 a 33 



•(20) 



where m( i )j k (i = 1 to 24, j = 1 to 6, and k = 1 to 3) 
is an element of a matrix M determined by the color 
reproduction characteristics of the projectors 33A and 
5 33B, and (i) is determined by the data values of the 

input color image data R, G, and B. 

When the multi-primary-color projectors 33A and 
33B are 6 -primary-color projectors , 24 matrices are 
switched in accordance with the region occupied by the 

10 data values of the input color image data R, G, and B. 

In addition, a^j is an element of a matrix A for 
converting the input color image data R, G, and B into 
XYZ values. 

A method of converting the XYZ values into 

15 multi-primary-color image data signals as display color 

image data by the color correction units 41A and 4 IB is 
described in, e.g., Japanese Patent Application 
No. 11-048042 in detail. 

The matrices M and A are set or measured in 

20 advance and stored in the color correction units 41A 

and 4 IB. 

[Geometrical Correction Units 42A and 42B] 

The display color image data (CI, C2, C3, C4, C5, 
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and C6) corrected by the color correction units 41A and 
4 IB are input to the geometrical correction units 42A 
and 42B, 

The geometrical correction units 42A and 42B 
5 perform geometrical correction on the basis of the 

display color image data (CI, C2 , C3, C4, C5, and C6) 
such that the partial display images are projected at 
correct positions by multi-primary-color projectors 33A 
and 33B. Details of the geometrical correction are 
10 disclosed in Jpn. Pat. Appln. KOKAI Publication 

No. 9-326 981, and a detailed description thereof will 
be omitted. 

[Primary Color Luminance Correction Units 43A and 43B 
(Gain/Bias Correction Means + Data Distribution Means + 

15 Nonunif ormity Correction Means)] 

The display signals (CI, C2, C3, C4, C5, and C6) 
which have undergone the geometrical correction by the 
geometrical correction units 42A and 42B are input to 
the primary color luminance correction units 43A and 

20 43B. The primary color luminance correction units 43A 

and 43B perform processing corresponding to gain/bias 
correction, data distribution, and nonunif ormity 
correction. The primary color luminance correction 
units 43A and 43B correct each primary color signal 

25 Cj(x,y) (j = 1 to 6) of each pixel on the basis of 

equation (21) and outputs the signal to the gray scale 
correction units 44A and 44B. 
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C; (x, y) = a j (x, y)Cj (x,y) + fi, (x,y) -(21) 
where aj(x,y) and j8j(x,y) are correction coefficients 
used for all processes including bias correction, data 
distribution, and nonunif ormity correction. 

On the same assumption as in the second embodiment, 
the signal value C'j(x,y) (j = 1 to 6) after gain/bias 
correction, data distribution, and nonunif ormity 
correction is given by 

(C'Kx,y)^ 
C'2(x,y) 
C'3(x,y) 
C'4(x,y) 
C'5(x,y) 
C'6(x,y)) 
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( 1M , ( x, y) 0 0 0 6 0 YA'(x, y) 0 0 0 0 0 
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"(22) 

Hence, aj(x,y) and j3j(x,y) are calculated by 
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a,(x,y)00000' 
0cc 2 (x,^)0000 
00a 3 (x,y)00Q 
OO0a A (x,y)0O 
O000a 5 (x, v)0 
00000a 6 (x,ri 



K(x,y)00000^ 
OK(x,y)0000 
OOK(x,y)000 
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000001/ k 6 (x,y) Jl^OOOOO K(x,y)J 

-(23) 
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(24) 



When the signal value C'j(x,y) (j = 1 to 6) is 
corrected by 

C'j(x,y) = a' J (x,y)C J (x,y) + j3 K x,y) ^ 
= P J (x,y)a J (x,y)C J (x,y) + /3 j (x,y) 

such that the display signal values C'j(x,y) (j = 1 to 
6) are ( 0 lf 0 2 , #3, 0 4 , 0 5 , and 0 6 ) when the input 
color image data are (0, 0, 0) or (C'i w , C'2 W ' c '3w 
C'4 W , C'5 W , and C'6 W ) when the input color image data 
are (Rw, Gw, Bw) , we have 

Pjix, y) = {C) w (x,y) ~ Pi (x,y))K<x, (x,y)C jw (x,y)) -(26) 

for 



C' jw (x,y) = K(x,y)(C JW (x,y)-C J0 (x,y))/k j (x,y) -(27) 
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r a n a n a u ^\(Rw(x,y)^ 



Gw(x,y) 
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(28) 



As described above, when the correction 
coefficients a'j(x,y) and j9j(x,y) are set/ and gain 
correction is done using the coefficient a'j(x,y), and 
5 bias correction is done using the coefficient 0j(x,y), 

a region where the input color image data has a smaller 
value than the bias and cannot be reproduced can be 
eliminated at a low- luminance portion , and color 
misregistration by bias correction can be prevented to 
10 enable accurate color reproduction at a high-luminance 

portion. 

FIG. 12 shows the state wherein the color display 
image is accurately reproduced by gain correction and 
bias correction using the correction coefficients 
15 a'j(x,y) and j8j(x,y). 

[Gray Scale Correction Units 44A and 44B] 

The arrangement of the gray scale correction units 
44A and 44B is the same as described in the first 
embodiment except that the number of correction data 
20 increases in correspondence with the six primary colors , 

and a detailed description thereof will be omitted. 
(Fourth Embodiment) 

A color image display system according to the 



( 



{ 
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fourth embodiment of the present invention will be 
described next with reference to FIGS. 13 and 14. The 
arrangement of the fourth embodiment is the same as 
that described in the first embodiment except 
5 projectors 3A and 3B and image data conversion 

apparatus 2, and a detailed description thereof will be 
omitted. 

In this embodiment, the image data conversion 
apparatus 2 comprises color correction units 51A and 
10 51B and gray scale correction units 52A and 52B, which 

are prepared in correspondence with the projectors 3A 
and 3B, as shown in FIG. 13. 

The color correction unit 51A (5 IB) has not only 
the color correction function but also the bias 
15 correction and color nonunif ormity correction functions 

and is constructed by a matrix correction unit 61 and 
bias correction unit 62, as shown in FIG. 14. 
[Matrix Correction Unit 61] 

Input color image data R(x / y) / G(x,y), and B(x,y) 
2 0 within an image region displayable by the projectors 3A 

and 3B are input from an image input apparatus 1 to the 
matrix correction unit 61. 

The input color image data R(x,y), G(x,y), and 
B(x,y) are converted, using a matrix M(x,y) 
25 corresponding to each pixel position (x,y) , which is 

given by 



! 
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r m n (x,y)m u (x,y)m n (x,y)^ 
M(x,y)= m 2l (x,y)m n (x,y)m 23 (x,y) -(29) 
K m 3X (x,y)m 32 (x,y)m 33 (x,y) j 

into matrix correction data R' (x,y) , G'(x,y), and 

B' (x,y) given by 
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G(x,y) 



(30) 



The matrix M(x,y) is calculated in advance by 
equation (31) and stored in the matrix correction 
unit 61. 

f W) . (*, y)»h2 (*> y) m n (*. y) ^ 
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••(31) 

where tji(x,y) is an element of a matrix T(x,y) for 
nonuniformity correction at the pixel position (x,y), 
and the remaining notation is the same as in the first 
embodiment. The matrix T(x,y) is calculated by 

r t u (x,y)t u (x,y)t, 3 (x,y)^ 

yM^yM^y) 
h 



Wx,y)t 32 (x,y)t 33 (x,y) 



r PnPnPn VY 9u(x,y)q n {x t y)q l3 {x t y) N 



(32) 



qAx,y)<i22(x,y)q23(x,y) 
{q 3i (x,y)q i2 (x,y)q^(x,y) 



where q-ji(x,y) is an element of a matrix Q(x,y) for 
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converting a display image by an i signal of the 
projector at the pixel position (x,y) into a sensing 
signal of the jth channel, which is sensed by a digital 
camera. 

The matrix Q(x,y) is calculated by equation (33) 
on the basis of image data obtained by sensing, with a 
digital camera, an image of each color, which is 
displayed on the full screen while setting the input 
signals to the projectors 3A and 3B as, e.g., signals 1 
(255, 0, 0), 2 (0, 255, 0), and 3 (0, 0, 255). 



q2xix 9 y)q 22 {x 9 y)q^{x 9 y) 



UbI (*>^)?32 (*>J0?33 ( X >y) J 



(R l (x J y)R 2 (x y y)R 3 (x y y) 



V 



255 00 
02550 



G x (x 9 y)G 2 (x,y)G 3 (x 9 y) 
B l (x,y)B 2 (x,y)B 3 (x,y) 100255^ 

-(33) 

where R k , Gfc, and B k (k = 1 to 3) are RGB signals 
obtained by sensing the kth display image, and pji is 
an element of a matrix P for converting a partial color 
image displayed on the basis of the i signal of the 
projector at the standard position into an image signal 
of the jth channel, which is sensed by a digital camera. 

The matrix P is calculated by equation (34) on the 
basis of image data obtained by sensing, with a digital 
camera, an image of each color, which is displayed at 
the standard position while setting the input signals 
to the projectors 3A and 3B as, e.g., signals 1 (255, 0, 
0), 2 (0, 255, 0), and 3 (0, 0, 255). 
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PnPvP* ~- W O -(34) 

where R k , G k , and B k (k = 1 to 3) are RGB signals 
obtained by sensing the kth display image • Arbitrary 
display images by the projectors 3A and 3B can be used 
to calculate the matrix Q(x,y) and matrix P as far as 
they are displayed by input signals of three 
independent colors . 
[Bias Correction Unit 62] 

The matrix correction data R'(x,y), G'(x,y), and 
B'(x,y) are output to the bias correction unit 62. The 
bias correction unit 62 subtracts, from the matrix 
correction data R'(x,y), G'(x,y), and B'(x,y), bias 
data N(x,y) corresponding to the pixel position (x,y), 
which is given by 



N{x,y) = 



n b (x,y)) 



(35) 



to calculate bias correction data R"(x,y), G"(x,y), and 
B " ( X /Y) given by 



(36) 



The bias data N(x,y) is calculated in advance by 
equation (37) and stored in the bias correction unit 62 
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The bias correction data R"(x,y), G"(x,y), and 
B"(x,y) output from the color correction units 51A and 
5 51B are input to the gray scale correction units 52A 

and 52B. The arrangement of the gray scale correction 
units 52A and 52B is the same as that described in the 
first embodiment, and a detailed description thereof 
will be omitted. 

10 t Pr °j ectors 3A and 3B] 

A preferred arrangement of the projectors 3A and 
3B used in this embodiment will be described next. The 
projectors 3A and 3B are designed to make the display 
luminance of each partial display image lower in the 

15 overlap region between the partial display images by 

the projectors 3A and 3B than in the remaining region 
(the single display region of each partial display 
image) . 

FIGS. 15A and 15B are views showing arrangement 
20 examples of the projectors 3A and 3B in the fourth 

embodiment . 

Each of the projectors 3A and 3B comprises a light 
source 71, a collimator lens 72, an ND filter 73A (73B), 
aluminum mirrors 74, 75, 78, and 79 as total reflection 
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mirrors, half mirrors 76 and 77, a prism 80 , an R 
liquid crystal panel 81 having an R filter, G liquid 
crystal panel 82 having a G filter, and B liquid 
crystal panel 83 having a B filter, which oppose the 
5 three light incident surfaces of the prism 80, and an 

optical system 84 including a projection lens. 

In the projector 3A, light from the light source 
71 is collimated through the collimator lens 72, 
transmitted through the ND filter 7 3A, reflected by the 

10 aluminum mirror 74, and then becomes incident on the 

half mirror 77, as shown in FIG. 15A. The half mirror 
77 passes the red spectral component of the incident 
light and reflects the remaining spectra. 

A transmitted light component Rl from the half 

15 mirror 77 is reflected by the aluminum mirror 7 9 and 

transmitted through the R liquid crystal panel 81 and 
then becomes incident on the prism 80. The reflected 
light components from the half mirror 7 7 become 
incident on the half mirror 76. 

20 The half mirror 76 reflects the green spectral 

component of the incident light and passes the blue 
spectral component. A reflected light component Gl 
from the half mirror 7 6 is transmitted through the G 
liquid crystal panel 82 and becomes incident on the 

25 prism 80. 

A transmitted light component Bl from the half 
mirror 76 is sequentially reflected by the aluminum 



mirrors 75 and 78 and transmitted through the B liquid 
crystal panel 83 and then becomes incident on the 
prism 80. 

The light components Rl, Gl, and Bl incident on 
the prism 80 are synthesized by the prism 80. The exit 
light is projected onto the screen 4 through the 
optical system 84 to display a partial color image. 

The projector 3B has the same arrangement as that 
of the projector 3A except that the ND filter 7 3B is 
different from the ND filter 73A, as shown in FIG. 15B. 

FIG. 16 shows the transmittance distribution of 
the ND filter 73A in the projector 3A and that of the 
ND filter 73B in the projector 3B. As shown in FIG. 16, 
the ND filters 7 3A and 7 3B have symmetric transmittance 
distributions . In the overlap region between the 
partial color images displayed by the projectors 3A and 
3B, the transmittance decreases toward the edge. 

This makes it possible to reduce the increase in 
bias in the overlap region between the partial color 
images displayed by the projectors 3A and 3B and 
consequently avoid any increase in luminance in the 
overlap region relative to that in the single display 
region. 

FIG. 17 shows biases when the projectors 3A and 3B 
have no ND filters as a comparative example. If the 
projectors 3A and 3B have the same bias, the bias in 
the overlap region of the partial color images is twice 



( 
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that at the portion (single display region) where a 
single partial color image is displayed by the 
projector 3A or 3B. 

To the contrary , when the projectors 3A and 3B 
5 have the ND filters 7 3A and 7 3B having transmittance 

distributions shown in FIG. 18A, respectively, in 
accordance with this embodiment, the bias in the 
overlap region equals that in the single display region, 
as shown in FIG. 18A. 

10 When the projectors 3A and 3B have different 

biases, a bias distribution as shown in FIG. 18B is 
obtained by using ND filters having transmittances 
shown in FIG. 18B. If the transmittance corrected 
portion of the ND filters completely matches the 

15 overlap region of the partial display images, the 

discontinuity of the bias in the overlap region can be 
improved. 

If the transmittance corrected portion of the ND 
filters does not completely match the overlap region of 

20 the partial display images, and the overlap region is 

narrower than the transmittance corrected portion, the 
bias value becomes smaller than the ideal bias value, 
as shown in FIG. 18C. 

If the overlap region is wider than the 

25 transmittance corrected portion of the ND filters, the 

bias value becomes larger than the ideal bias value, as 
shown in FIG. 18D. 
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As described above , even when the transmittance 
corrected portion of the ND filters and the overlap 
region of the partial display images do not completely 
match, the discontinuity of bias can be improved as 
5 compared to a case without correction. 

Other arrangement examples of the projectors 3A 
and 3B will be described next with reference to 
FIGS. 19 to 22. FIG. 19 shows the projector 3A, though 
this also applies to the projector 3B. 

10 A description will be made using the same 

reference numerals as in FIGS. 15A and 15B to denote 
the same parts in FIGS. 19 to 22. Referring to 
FIG. 15A, the ND filter 7 3A is arranged immediately 
behind the collimator lens 72. However, referring to 

15 FIG. 19, the ND filter 73A is inserted between the 

aluminum mirror 74 and the half mirror 77. Referring 
to FIG. 20, the ND filter 7 3A is inserted between the 
prism 80 and the optical system 84. Referring to 
FIG. 21, three ND filters 73A are inserted between the 

20 prism 80 and the liquid crystal panels 81, 82, and 83. 

In either example of the projectors shown in 
FIGS. 15A, 15B, and 19 to 21, the position of the ND 
filter can be easily changed to set its direction such 
that the transmittance corrected portion corresponds to 

25 the overlap region between the partial display image by 

one projector having the ND filter and the partial 
display image by the other projector. 
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In the projector 3A shown in FIG. 22 , a complete 
light-shielding plate 85 is located at an end portion 
between the prism 80 and the optical system 84 , thereby 
dimming light corresponding to the overlap region of 
5 the partial display images by the projectors 3A and 3B. 

The embodiments of the present invention have been 
described above. However, the present invention is not 
limited to the above-described embodiments, and various 
changes and modifications can be made, as will be 
10 described below. 

(a) In the above embodiments, the input color 
image data is RGB image data input by the image input 
apparatus. However, the present invention is not 
limited to this, and XYZ image data or display signal 

15 values in the partial color image display means may be 

used . 

(b) In the above embodiments, a reflection- type 
projector is used as a partial color image display 
means. However, the present invention is not limited 

20 to this and can also be applied to a case wherein a 

display apparatus of another scheme, such as a rear 
(back projection type) projector, CRT display, or 
liquid crystal display, is used as the partial color 
image display means . 

25 (c) In the above embodiments, as a plurality of 

partial color image display means, two 3-primary-color 
projectors or two 6 -primary-color projectors are used. 
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However , the number of display means and the number of 
primary colors are not limited to specific values. For 
example, four 6 -primary-color projectors may be used as 
the partial color image display means, 
5 (d) In the above embodiments, data used to correct 

the difference in color reproduction characteristic 
between the partial color image display means by the 
color correction means is obtained by measurement using 
a spectrophotometer. Instead of the spectrophotometer, 

10 a digital camera may be used. In this case, the 

spectral sensitivity characteristic of the digital 
camera is represented by linear conversion of a color 
matching function, the data for correcting the 
difference in color reproduction characteristic between 

15 the display apparatuses can be accurately measured. In 

place of the spectrophotometer, a colorimeter or 
illuminance meter may be used. 

(e) In the above embodiments, the color correction 
means performs 3X3 matrix conversion or conversion 

20 from three primary colors into multiple primary colors. 

Instead, color conversion based on another scheme, e.g., 
conversion using a neural network, non-linear conver- 
sion including a term of higher order, conversion using 
a three-dimensional lookup table and interpolation may 

25 be executed. In any case, it is important that the 

color correction means uses data obtained by measuring 
the color reproduction characteristic data of each 



partial color image display means. 

(f) In the above embodiments, as described in f 
e.g., the second embodiment, the distribution 
coefficients Kl(x,y) and K2(x,y) having linear 

5 distributions as shown in FIG. 8 are used by the data 

distribution units 14A and 14B. However, distribution 
coefficients having curve distributions as shown in 
FIG. 23, which spatially smoothly change in the overlap 
region between the partial display images by the 
10 projectors 3A and 3B as the partial color image display 

means, may be used. 

(g) In the above embodiments, in the projector 3A 
shown in FIG. 22, a complete light-shielding plate is 
located at an end portion between the prism and the 

15 optical system. However, the position of the 

light-shielding plate is not limited to this and may be 
between the optical system and the screen. 

Preferred implementations of the present invention 
disclosed in the above-described embodiments will be 
20 listed below. 

(1) A color image display system comprising: 
a plurality of partial color image display means 
for, upon receiving display color image data, 
displaying partial color images to be synthetically 
25 displayed as a color image of one frame; and 

image data conversion means for converting input 
color image data into the display color image data to 



t 
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be input to the partial color image display means, 
characterized in that 

the image data conversion means comprises color 
correction means for correcting the difference in color 
5 reproduction characteristic between the partial color 

image display means . 

(1-1) A color image display system according to 
(1), characterized in that the color correction means 
performs correction on the input color image data, 
10 including non-linear conversion. 

(1-2) A color image display system according to 
(1), characterized in that the color correction means 
comprises data acquisition means for acquiring data to 
be used to correct the color reproduction charac- 
15 teristics. 

(1-3) A color image display system according to 
(1-2), characterized in that the data acquisition means 
comprises at least one of a spectrophotometer, 
colorimeter, image sensing means, and illuminance meter. 
20 [Effects] Even when the plurality of partial color 

image display means have different color reproduction 
characteristics, displayed colors match in the entire 
color image synthetically displayed as one frame. 
Hence, discontinuous joints between the partial color 
25 images are eliminated, and a high-quality color image 

can be displayed as a whole. 

(2) A color image display system comprising: 



( 



a plurality of partial color image display means 
for, upon receiving display color image data, 
displaying partial color images to be synthetically 
displayed as a color image of one frame; and 
5 an image data conversion means for converting 

input color image data into the display color image 
data to be input to the partial color image display 
means, characterized in that 

the image data conversion means comprises 
10 correction means for correcting a bias of the input 

color image data so as to display the partial color 
images on a predetermined set bias in the plurality of 
partial color image display means. 

(2-1) A color image display system according to 
15 (2), characterized in that the set bias has a 

predetermined value. 

(2-2) A color image display system according to 
(2) or (2-1), characterized in that the set bias is one 
of actual biases of the partial color image display 
20 means, with which the projective vector to a 

predetermined color vector is maximized. 

(2-3) A color image display system according to 
any one of (2), (2-1), and (2-2), characterized in that 
the set bias is calculated from all color image data 
25 input to the correction means and the bias in the total 

display region of the partial color image display means. 

(2-4) A color image display system according to 



any one of (2) to (2-3), characterized in that the set 
bias is calculated on the basis of the difference 
vector in projective vector to a predetermined color 
vector between the color image data input to the 
correction means and the actual bias of the partial 
color image display means . 

(2-5) A color image display system according to 
any one of (2-2) to (2-4) , characterized in that the 
predetermined color vector is the white vector of the 
partial color image displayed by the partial color 
image display means . 

(2-6) A color image display system according to 
(2), characterized in that the set bias spatially 
smoothly changes . 

(2-7) A color image display system according to 
any one of (2) to (2-6) , characterized in that the 
correction means corrects the input image data so as to 
accurately reproduce a predetermined color (in the 
above example, (C' lw , C' 2 w c '3w c '4w c '5w and 
C'6 W )) of the image displayed by the partial color 
image display means . 

(2-8) A color image display system according to 
(2-7), characterized in that the correction means 
performs not only bias correction but also gain 
correction on the input color image data in units of 
primary colors . 

[Effects] A case wherein the display color image 



data input to the partial color image display means has 
a value smaller than the bias and cannot be reproduced 
is eliminated or reduced. 

In addition, when the set bias is calculated from 
5 the all input color image data and all biases in the 

display region, the set bias can be minimized, and 
color misregistration by the set bias can be minimized. 
Furthermore, a case wherein the display color image 
data input to the partial color image display means has 
10 a value smaller than the bias and cannot be reproduced 

is eliminated or reduced. 

(3) A color image display system comprising: 

a plurality of partial color image display means 
for, upon receiving display color image data, 
15 displaying partial color images to be synthetically 

displayed as a color image of one frame; and 

image data conversion means for converting input 
color image data into the display color image data to 
be input to the partial color image display means, 
20 characterized in that 

the image data conversion means comprises data 
distribution means for distributing the input color 
image data to the display color image data to be input 
to the partial color image display means so as to 
25 display, at a predetermined ratio in an overlap region, 

the partial color images contained in the overlap 
region between the partial color images displayed by 



the partial color image display means . 

(3-1) A color image display system according to 
(3), characterized in that the data distribution means 
distributes the input color image data to the display 
color image data to be input to the partial color image 
display means by reducing the ratio toward an end of 
each partial color image displayed by the partial color 
image display means . 

(3-2) A color image display system according to 
(3) or (3-1), characterized in that the data 
distribution means distributes the input color image 
data to the display color image data to be input to the 
partial color image display means using a random number - 

[Effects] Even in the overlap region where the 
partial color images displayed by the plurality of 
partial color image display means overlap, a desired 
color can be accurately displayed. 

In addition, when the input color image data is 
distributed to the display color image data to be input 
to the partial color image display means by reducing 
the ratio toward an end of each partial color image, 
generation of discontinuous joints due to the color 
difference between the partial color images by the 
partial color image display means can be relaxed. 

Furthermore, when the input color image data is 
distributed using a random number, generation of 
discontinuous joints due to the color difference 



between the partial color images by the partial color 
image display means can be more effectively relaxed. 

(4) A color image display system comprising: 

a plurality of partial color image display 
means for, upon receiving display color image data, 
displaying partial color images to be synthetically 
displayed as a color image of one frame; and 

image data conversion means for converting input 
color image data into the display color image data to 
be input to the partial color image display means, 
characterized in that 

the image data conversion means comprises 
nonuniformity correction means for correcting a color 
nonuniformity in partial color image displayed by the 
partial color image display means . 

(4-1) A color image display system according to 
(4), characterized in that the nonuniformity correction 
means corrects the color nonuniformity using image data 
sensed by a digital camera. 

(4-2) A color image display system according to 
(4) or (4-1) f characterized in that the nonuniformity 
correction means corrects the color nonuniformity by 
correcting a luminance nonuniformity in each primary 
color of the partial color image displayed by the 
partial color image display means. 

(4-3) A color image display system according to 
any one of (4), (4-1), and (4-2), characterized in that 



the nonunif ormity correction means corrects the color 
nonuniformity by linear conversion using a color 
nonuniformity correction coefficient which is obtained 
on the basis of primary color image data obtained by 
sensing a display image of each primary color with a 
digital camera. 

[Effects] When the partial color image displayed 
by each partial color image display means is corrected, 
high-quality display is done in each partial color 
image, and also discontinuous boundaries between the 
partial color images due to the color nonuniformity 
which changes in units of partial color image display 
means can be prevented. 

In addition, when the color nonuniformity is 
corrected using data obtained by sensing with a digital 
camera, nonuniformity correction can be performed in 
units of pixels. In this case, if the color 
nonuniformity is caused by a luminance nonuniformity of 
each primary color, data for color nonuniformity 
correction can be measured using a digital camera 
having an arbitrary spectral sensitivity characteristic. 

Furthermore, when the color nonuniformity is 
corrected by linear conversion using a color 
nonuniformity correction coefficient obtained on the 
basis of primary color image data obtained by sensing 
the display image of each primary color with a digital 
camera, color nonunif ormities with chromaticity values 



changing in units of primary colors can also be 
corrected. 

(5) A color image display system comprising: 

a plurality of partial color image display means 
for, upon receiving display color image data, 
displaying partial color images to be synthetically 
displayed as a color image of one frame; and 

image data conversion means for converting input 
color image data into the display color image data to 
be input to the partial color image display means, 
characterized in that 

the partial color image display means is designed 
to display the partial color images with display 
luminance lower in an overlap region between the 
partial color image displayed by one partial color 
image display means and the partial color image 
displayed by the other partial color image display 
means than in a remaining region. 

(5-1) A color image display system according to 
(5), characterized in that each partial color image 
display means has an ND filter whose transmittance 
becomes low in the overlap region. 

(5-2) A color image display system according to 
(5), characterized in that the partial color image 
display means lowers the display luminance in the 
overlap region by eclipse by a light-shielding member 
inserted in the optical path. 
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[Effects] When the partial color image display 
means are designed to lower the display luminance in 
the overlap region between the partial color images, an 
increase in bias in the overlap region can be 
5 eliminated or reduced. 

In this case, when an ND filter whose 
transmittance becomes low in the overlap region is used, 
such a partial color image display means for lowering 
the display luminance in the overlap region can be 
10 easily implemented. 

In addition, when the display luminance is lowered 
in the overlap region by eclipse by the light-shielding 
member inserted in the optical path, such a partial 
color image display means for lowering the display 
15 luminance in the overlap region can be implemented at 

low cost. 

(6) A color image display system according to any 
one of (1) to (5), characterized in that each partial 
color image display means comprises a multi-primary- 
20 color display having at least four primary colors. 

[Effects] When a multi-primary-color display is 
used as the partial color image display means, a larger 
color reproduction region can be realized. 

As has been described above, according to the 
25 present invention, in the data conversion apparatus for 

converting input color image data into display color 
image data to be input to the partial color image 
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display means, color correction, bias correction, data 
distribution, and color nonunif ormity correction are 
performed, or the plurality of partial color image 
display means are designed to lower the display 
5 luminance of each partial color image in the overlap 

region between the partial color images displayed by 
the partial color image display means. Thus, a 
plurality of partial color images can be synthetically 
displayed as a color image of one frame having a 

10 satisfactory quality. 

Additional advantages and modifications will 
readily occur to those skilled in the art. Therefore, 
the invention in its broader aspects is not limited to 
the specific details and representative embodiments 

15 shown and described herein. Accordingly, various 

modifications may be made without departing from the 
spirit or scope of the general inventive concept as 
defined by the appended claims and their equivalents. 



